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ABSTRACT 

The  bounded  invertibility  (as  a  linear  map  on  say)  of  a  bounded, 

strictly  m-banded  biinfinite  matrix  A  is  shown  to  be  equivalent  to  a 
dichotomy  or  splitting  of  its  kernel  &  (as  a  map  on  RZ)  into  1fl+  and 
with  containing  those  which  decay  exponentially  at  +°°,  and  tl- 

those  which  decay  exponentially  at  together  with  a  certain  uniformity 

(with  respect  to  the  sequence  index)  of  this  direct  sum  decomposition.  The 
approximability  of  the  solution  of  the  biinfinite  system  =  Ja  by  solutions 
of  finite  sections  of  this  system  is  characterized  in  terms  of  linear 
independence,  uniform  as  I  --*■  -(*«),  of  over  I  U  I  ,  with  I  an 

integer  interval  of  length  dim  Ifl*,  **+,-. 
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SIGNIFICANCE  AND  EXPLANATION 


pline  approximation  is  often  most  effective  when  the  breakpoint  (knot) 


sequence  can  be  chosen  suitably  nonuniform.  At  the  same  time,  standard  spline 
approximation  schemes  (such  as  least-squares  approximation  by  splines)  are  so 
far  only  known  to  be  bounded  as  long  as  the  breakpoint  sequence  is  almost 
uniform.  Any  such  bound  is  obtained  (explicitly  or  implicitly)  in  terms  of  a 
bound  on  the  inverse  of  certain  matrices  which  are  banded.  Any  attempt  at 
establishing  bounds  for  more  general  breakpoint  sequences  must  therefore  come 
to  grips  with  the  inverses  of  these  band  matrices.  The  hope  is  that  Demko's 
discovery  of  the  exponential  decay  of  band  matrix  inverses  will  lead 
eventually  to  those  desired  bounds.  v 

A 

In  the  present  report,  this  exponential  decay  is  related  to  the 
exponential  decay  of  solutions  of  the  homogeneous  problem  Ax_  =  0_.  In 
particular,  proofs  are  provided  for  the  statements  made  in  the  earlier  report 


MRC  TSR  2049  entitled  "What  is  the  main  diagonal  of  a  biinfite  band  matrix?" 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  MRC,  and  not  with  the  author  of  this  report. 


DICHOTOMIES  FOR  BAND  MATRICES 
Carl  de  Boor 

Dedicated  to  Garrett  Birkhoff  on  the  occasion  of  his  70th  birthday 

1.  Introduction.  In  retrospect,  the  exponential  decay  of  the  Lagrange  splines  for 
cubic  spline  interpolation  at  knots  proved  in  Birkhoff  and  de  Boor  [1]  appears  as  the  first 
instance  in  spline  theory  of  exponential  decay  of  band  matrix  inverses.  Since  then,  the 
exponential  decay  of  band  matrix  inverses  has  been  used  successfully  by  I. J. Schoenberg  and 
others  (see,  e.g.,  [10])  in  the  analysis  of  cardinal  splines  in  which  the  band  matrices  in 
question  are  Toeplitz  matrices,  hence  well  known  to  have  exponentially  decaying  inverses. 

In  adapting  the  proof  of  Douglas,  Dupont  and  Wahlbin  [6]  for  the  boundedness  of  least- 
squares  approximation  by  splines  on  a  quasi-uniform  mesh  to  more  general  spline 
approximation  schemes,  S.  Demko  [5]  discovered  that,  in  a  nontrivial  way,  all  band  matrix 
inverses  decay  exponentially  away  from  the  main  diagonal.  At  that  time,  I  had  used  the  idea 
behind  the  Douglas,  Dupont  and  Wahlbin  argument  to  carry  some  of  [1]  over  to  odd-degree 
spline  interpolation  at  knots,  but  was  pleased  to  find  (in  [2])  how  nicely  the  idea  behind 
Demko's  argument  simplified  the  proofs. 

As  a  kind  of  afterthought,  I  proved  in  [2]  that  any  nontrivial  solution  of  the 
biinfinite  homogeneous  linear  system  Ax  =  0_  must  grow  exponentially  in  at  least  one 
direction  in  case  A  is  a  band  matrix,  bounded  and  boundedly  invertible  (on  ,  say). 

With  that  in  mind,  though,  further  considerations  of  odd-degree  spline  interpolation  at 

knots  led  to  the  characterization  of  bounded  invertibility  (as  a  map  on  )  of  a  band 

z 

matrix  in  terms  of  a  dichotomy  or  splitting  of  its  kernel  (as  a  map  on  R  ).  These  results 
were  stated  in  [3]  and  are  restated  in  greater  detail  and  proved  here. 

I  have  to  confess  now  that  I  became  only  recently  familiar  with  the  well  established 
theory  of  ordinary  and  exponential  dichotomies  for  ordinary  linear  differential  operators 
in  Banach  space,  particularly  through  Coppel's  eminently  readable  book  [4].  I  have  triol  to 
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deduce  the  results  presented  here  from  those  in  Cbppel's  hook  by  reinterpreting  band 

matrices  as  difference  operators  and  then  going  from  the  discrete  to  the  continuous.  But  it 

seemed,  in  the  end,  more  satisfactory  and  "sachgerecht"  to  argue  directly  in  terms  of  band 

matrices.  Perhaps  someone  else  will  be  more  successful  in  this  translation  effort.  In  any 

event,  Ooopel's  book  could  be  an  inspiration  to  those  studying  biinfinite  band  matrices. 

Here  is  an  outline  of  the  paper.  In  Section  2,  it  is  proved  that,  for  a  strictly  m~ 

banded  matrix  A,  there  exists  an  i  -columned  matrix  A^“^  for  which  AA^~^  =  1  =  A^~^A 

00 

iff  the  kernel,  ft,  ,  of  A  ( as  a  man  on  RZ  )  is  the  direct  sum  of  ?l+  and  , 

a  A  A 

with  consisting  of  those  elements  of  which  are  bounded  at  •  In  Section  3, 

the  hounded  invert ihility  (on  Z^  )  of  a  hounded  strictly  m-banded  matrix  A  is  shown  to 
be  equivalent  to  having  the  elements  of  decay  exponentially  at  *»  together  with  a 

certain  uniformity  condition.  Finally,  in  Section  4,  the  approximahilitv  of  the  solution  of 

the  biinfinite  system  Px_  =  bv  solutions  of  finite  sections  of  this  system  is 

* 

characterized  in  terras  of  linear  independence,  uniform  as  X  - ►  -(*«*)  ,  of  over 

■f  —  * 

I  U I  /  with  I  an  integer  interval  of  lenath  dim  ft  • 

A 


2 


Ik 


2,  The  index  of  a  band  matrix.  The  r-th  diaaonal  or  band  of  the  biinfinite  matrix  A 

is  the  seouence  (A(i-r,i)).  .  Here  and  below,  A(i,j)  denotes  the  (i,j)-th  entry  of  A. 

1=-°° 

A  biinfinite  matrix  A  is  banded  {or,  a  band  matrix)  if  all  but  finitely  many  of  its  bands 
are  zero.  Such  a  band  matrix  A  aives  rise  to  a  linear  map  on  ,  the  linear  space  of 
all  real  biinfinite  seauences,  and  we  will  identify  A  with  that  map. 

A  biinfinite  matrix  A  is  called  m- banded  if  all  but  m+1  consecutive  bands  are 
zero.  (I  chose  the  term  ”m-bandedM  in  preference  to  " (n+1 ) -banded"  since  such  a  matrix  is 
equivalent  to  an  m-th  order  difference  operator,  its  kernel  usually  has  dimension  no  bigger 
than  m  ,etc.)  Thus  A  is  m-banded  iff  for  some  £ 

A(i-fc,j)  ^  0  implies  i  <  j  <  i+m  . 

Unless  otherwise  indicated  (e.q.,  by  context),  I  will  always  assume  that  i  -  0  .  This  is 

-l 

merely  a  normalization  achieved  by  considerino  F  A  instead  of  A  ,  with  F  the  shift , 

( F,a_)  ( i )  ;  —  aU+1),  all  i  ,  all  _a  in  RZ  , 

z 

an  invertible  operator  which  preserves  more  or  less  all  interesting  structures  in  R  . 

The  handed  matrix  A  is  called  strictly  r.i-bandtd  if 

(2.1)  K  i,i)  A(  i,i+m)  ft  n,  all  i, 

i.e.,  the  first  and  last  nontrivial  hand  is  never  zero.  This  nontrivial  assumption  insures 

that,  for  every  i  ,  every  a  in  if  gives  rise  to  one  and  only  one  sequence  _f  with 

Af=0_  and  _f(i+j)  =  a  ^ ,  j=  1 , . . .  ,m  . 

To  put  it  differently,  with 

V-A  :=  {f  £  RZ  i  Af  =  0  } 

denoting  the  kernel  or  nullspace  of  A  ,  strict  m-bandedness  of  A  insures  that 

(7.2)  for  every  i,  the  map  - ►rf"  :  _f  1 — ►  Hi]  is  one-one  and  onto. 

Here  and  below,  _f  [  i]  denotes  the  m-vector  (_f  (  i+1 )  , . .  •  ,_f  (  i+m) )  .  For  a  subset  F  of 
RZ  ,  we  use,  correspondingly, 

Ffi]  :=  {f [i]  :  ftF}  . 

Also,  it  will  he  convenient  to  denote  by  E^  the  inverse  of  the  i-th  map  in  (2.7),  i.e., 

(2.3)  for  all  f-eR,  E^ffi])  =  £  . 


3 


E|  is  the  "fundamental  solution"  for  the  homogeneous  system  * 

Af  =  0_ 

which  produces  the  particular  solution  _f  =  E^_a  corresponding  to  the  given  initial 
values  _f  [i]  =  _a  . 

It  is  the  purpose  of  this  paper  to  characterize  certain  aspects  of  strictlv  m-han*^1 
matrices  in  terms  of  their  kernel.  It  is  therefore  important  to  realize  that  suet  matrices 
are  essentially  determined  by  their  kernel. 

Proposition  1.  If  H  is  an  m-dimensional  subspace  of  R2  which  satisfies  (?.?),  t^er. 
there  exists,  up  to  left  multiplication  by  an  invertible  diagonal  matrix,  exactly  one 
strictly  m-banded  matrix  A  for  which  . 

We  also  introduce  two  subspaces  of  H, 

if  {f  eft:  Tim  f(i)  <  «  }  , 

with  *  standing  for  either  +  or  -  .  (We  continue  this  convenient  use  of  *  throuc’-out 
the  paper.) 

Definition.  The  strictly  m-banded  matrix  A  has  index  k  ,  or,  index ( A)  =  k,  in 

case  fL  =  ft*  «  H.  and  dim  Tl*  =  k  . 
f*  A  A  A 

In  particular,  if  A  has  index,  then 

i.  VM  + 

m  :=  dim  =  index(  A)  , 

m"  :  =  dim  =  m  -  index(  A)  . 

The  notion  of  index  is  introduced  here  since  A  has  index  iff  A  is  "invertible”  i~ 
a  certain  weak  sense.  In  the  followina  statement  of  this  eauivalence,  we  use  the  "M  v  a  re¬ 
sequence  6^  defined  by 

6  .  (  j )  =  6  .  .  . 

— i  J  in 

Proposition  2.  The  strictly  m-banded  matrix  A  has  index  iff  for  every  i  , 


4 


exists  exactly  one  c^  £  Z^  with  Ac^  =  (S  • 


This  proposition  is  given  in  [3],  but  we  give  here  its  proo*,  sliahtlv  altered,  for 
completeness . 

Proof.  Since  3T  Afl+  is  the  kernel  of  A|  ,  there  is  at  most  one  solution  (for  anv 

03 

particular  i  )  if  and  only  if  IT  tilt  *  {fl}  *  Hence  it  is  sufficient  to  nrnve  t^at,  oiver 
uniqueness,  we  have  m+  +  m”  =  m  iff  there  is  a  solution  for  every  i  . 


For  this,  note  that  c^ 

satisfies 

*£i  = 

iff 

(2.4)  Ci 

c .  :  = 

—l 

Fi-i-iri-1] 

on 

) -»,i+m[ 

c?  :  = 
— i 

EA[1] 

on 

1  i,“! 

and 

i+m 

(2.5) 

1  A(  i  ,  j  )  c.  (  j ) 

j-i 

— 

1 

In  words,  £^  is  necessarilv 

determined 

by  the  ( m+ 1 ) 

-vector  (_c^ (  i ) 

, . . .  ,£i (  i+m)  )  :  for 

J <i+m,  c^tj)  coincides  with  the  extension  of  c^fi 

-1) 

= 

(£*(  i)  /  •  • 

•  '£i(  i+ri"1 ) )  to  an 

element  of  ,  while,  for 

j>  i  <  £i<j) 

coincides  with 

the  extension  of  _c^[i!  = 

( c ^ ( i+1 ),...,£!< i+m) )  to  an 

element  of 

HI.  Conseauently , 

c .  e  Z 

—l  00 

iff 

(2.5) 

♦  —  * 

£i  e  Tfl  . 

Now  assume  m-  +  m+  =  m 

.  Note  that 

(2.4)  -  (2. 

5) 

constitute  a 

linear  system 

*  0  ‘ 

0 

(2.7) 

P.  (c  . 
l  — l 

1  ( i ,i+m] ) 

= 

1 

0 

n  _ 

I 

in  the  m+1  unknowns  £,(i). 

. .  .  ,£j  (  i+m) 

,  with  the  first 

m-m”  homoaeneous  enuations 

ensuring  that  Ei_%£i[i-1]  lies  in  R"  ,  i.e.,  £  fi-1]  £  JTfi-I!  ,  the  next  equation,  ++f 

only  inhomogeneous  one,  being  just  (2.M,  and  the  last  m-m+  homocreneous  enuations 
ensuring  that  E±jci [  il  lies  in  H.+  ,  i.e.,  £i[i]  £  Ul+[i]  .  Since  m”  *  m+  =  n  bv 

assumption,  this  means  that  (2.7)  has  as  many  enuations  as  unknowns  and,  since  we  alreadv 


know  that  it  has  at  most  one  solution,  the  existence  of  a  solution  follows 


Conversely,  assuming  the  existence  of  a  solution  for  every  i  ,  consider 


m+ 1  vi* 

:  R  - ►  ©l  : 


£  a  .c  .  . 

3=0  ™ 


with  *  standing  for  +  or  -  (as  before),  and  m  :  =  m  +  m  •  Then 


null  *  m+1  -  rank  $  >  m+1  -  rr 


m  +1  ,  if 


m+1  ,  if 


Conseauently ,  there  exists  a  e  ker<J>  A  ker<J>  \  { 0 }  •  For  this  a_  , 


d  :=  I  a.c.,.  ¥  0 

3=0  ~ 


since  (c_^)  is  obviously  linearly  independent.  On  the  other  hand,  since 


c,  . (s)  ,  for  s  <  i+m  _ 

c.+  .(s)  =  ^+:J  ,  j«0,...,m 

1  -1  —i+j  ( S )  .^ors'>^+m 


we  find 


d  = 


I  ‘  a.c..  on  I  — «*> ,  i+Tn  t 
0  3-1+;) 


^0  aj£i+j  on 


and  therefore,  by  choice  of  a_  ,  _d(  s)  =  0  for  s  <  i+m  and  s  >  i+m  .  This 
m  i  m  ,  and  therefore,  since  by  assumption  "tl  A  Kl  *  {0},  i.e.,  m  +m  <  m 
conclusion  m4"  +  m  ~  m  follows  .  Ill 


Example  1.  Let  A  be  the  tridiagonal  matrix  whose  rows  are  alternately 

2,0,1  .  Then  the  two  sequences 

-  i  i+ 1  i+2 

f  ‘ -  •••,0,2  ,0,2  ,0,2  ,••• 

f  j=  •••,2,0,2  ,0,2  ,  0  ,■•• 


6 


the  maps 


implies 
,  the 

1,0,2  and 


are  both  in  »=  #A  and  linearly  independent  and,  obviously,  ¥1*  =  span{f  }  .  Hence  A 
has  index  1  .  The  construction  of  as  in  the  proof  boils  down  to  wanting 


a  f  on  ] “», i+ 1 ] 

+  4- 

a  on  [  i+ 1 [ 


and 

(2.8)  A(i,i)_c^(i)  +  A(  i,i+1  )_c^(  i+1 )  +  A(  i  ,i+2  )_c^(  i+2 )  =  1  . 

This  forces  a  and  a+  to  satisfy 

(a+f+  -  a’f')fi+l)  =  0 

A(  i,i+2)  (a+f+  -  cff~)(i+2)  =  1 

the  latter  from  (2.8)  usina  the  fact  that  _f“  e  tl .  In  particular,  since  _f+  and  _f’ 
vanish  alternately  (though,  never  together),  this  shows  that  =  0.  iff  /  £ 


The  nroof  of  Pronosition  2  yields  the  following  additional  facts. 

(i)  The  nontrivial  seouence  d  =  Za  .c  .  .in  the  second  part  of  the  proof  has  its 

j-i+j 

support  in  the  interval  (i+m,  i+m!  ,  i.e.,  at  the  sinale  point  i+m  .  Since  (_c  ^ )  is 

linearly  independent,  it  follows  that,  up  to  scalar  multiple,  ( a^  )  is  the  unique  (finite) 

seouence  for  w+ich  has  its  support  at  the  sinale  point  i+m  .  In  particular, 

m+ 1 

there  exists  exactly  one  a.  e  R  for  which 

“i 


£  a . ( j )  c.  .  =  6 

.  „  —  i  — 1+3  — i+m 

J=° 

This  says  that  the  banded  matrix  A1  given  by 

A*(i,j)  := 

satisfies 


Z  £k(i)A'(k(j) 


E  a  .  ( k- j+m)c  ( i) 

k  _k 


=  la, 

k” 


( k)C| 


(i) 


6  .  (  i)  . 
-1 


In  other  words,  the  matrix  A^~^ 
constructed  in  the  proposition, 


whose  k-th  column  consists  of  the 
all  k,  satisfies 


AA 


(-) 


=  i  =  a(-’a' 


f^-sequence  _ck 


7 


r 


(  AAf_>  )  A1 


A(A(~'a')  =  A  .  (There  is 


and  this  implies  at  once  that  A1 
difficulty  here  with  the  chanqe  in  the  order  of  summation,  since  all  suns  are  e ‘:r  ~  -  j  • 
finite.)  Ihis  proves 


Corollary  1.  If  A  has  index,  then  A  is  invertible  in  the  sense  tkat  there  ex  is 


a  matrix  A 


<-> 


(necessarilv  unique)  whose  columns  are  hounded  and  for  wb icu 
AA( 


=  1  =  A(  “ )  A 


In  particular,  A^(  A^-^ )T  =  1  ,  but  there  is  no  guarantee  that  the  columns  of 
are  bounded.  For,  with  D  any  invertible  diagonal  matrix,  PA  still  has  (the  sane)  in* 
but  now 

(DA)("}  -  A^D*1  , 

some  of  whose  rows  may  be  made  unbounded  by  proper  choice  of  D  .  For  examnle,  in  Fxa^rl 


1,  A 


and  A 


rr>  ( _  \  ti 

i  ’  “  A  as  one  easily  verifies,  hence  both  A  and  A'  have  in i 

1  .  But,  with  D  =  diagf...,  2i^2,  ...]  ,  (DA)T  has  no  index  since  contains  t 


. ! ,  ( DA) '  again  ha r 


bounded  sequence  D'h”  ,  while,  e.q.,  with  D  =  diag[..., 
index,  but  now  index  2  .  In  narticular,  now 

(DA)(~)T  *  (DA)7''5 

even  though  both  matrices  satisfy  the  equations 

(DA) TX  =  1  =  X ( DA) T 

(for  X).  The  uniqueness  assertion  for  A^’^  only  covers  £  -columned  matrices  , 

00 

A^  ^  does  function  as  the  inverse  for  A  ,  at  least  as  the  inverse  for  rest *- it 

to  sequences  of  finite  support. 

(  ii)  A  repeat  of  the  second  part  of  the  proof  of  Proposition  but  with  n  -  1 

rather  than  equal  to  m+  +  m  ,  shows  that  (in  case  A  has  index)  anv  senne^ce  - 

with  c  ker4>+A  ker<{>  must  vanish  identicallv,  hence  ker$+A  ker£~  -  {p}  .  Finre  now 

*  *  ★  *  * 

rank<p  =  m  -  null<|>  >  m  -  m  ,  this  implies  rank<J>  =  m  and  so  proves 


Corollary  2.  If  A  has  index,  then,  for  every  i,  the  map 


P 


1 


carries  F?1  onto  XC  • 

This  corollary  shows  that  any  m  consecutive  columns  of  A* ~ )  supply  all  the 
information  needed  to  construct  a  basis  for  ft+  and  .  Example  1  above  shows  that  it 

is  usually  not  sufficient  for  this  purpose  to  consider  fewer  than  m  consecutive  columns. 

We  conclude  from  (2.4)  and  corollary  2  that,  for  any  i  and  any  r  >  0  ,  the  columns 
of 


ft  : 


j=1 


a  .c. 

T-i+D 


A 


(-) 


( 


i+1,  . 

i-r-m+1 


itm^ 

i-r' 


and 


( - )  r i+ 1 ,  ...  ,  i+m  i 

' i+r+1 , . . . ,  i+r+m; 


span  'ft+ [  i]  and  fl,” [ i]  ,  respectively,  hence  have  rank  m+  and  m-  ,  respectively.  This 
implies 


T  ( -  IT 

Corollary  3.  If  both  A  and  A  have  index  and  A 

index! A)  +  index! AT)  =  m  . 


«T<-) 


then 


( iii)  Finally,  we  use  Cbrollary  2  to  point  out  a  particularly  useful  choice  for  the 
matrix  B^  in  (2.7).  We  know  that 


£i+j<s>  = 

W’ 

for 

s  < 

i+j+m 

-i+j!s) 

for 

s  > 

i+j 

Hence,  from  Cbrollary  2,  the  sequence 

•  •  •  * 

—i-1 

[i-1]  must  contain  a  basis 

for  tl+[i-11  ,  say  £,  [i-1],  ...,  c,  +[i-1]  .  Since  ft[i-1]  =  KL+[i-1]  «  TftT [ i— 1]  , 

1  "m 

can  therefore  find  X*,  . X++  with  support  in  [i,i+m-1]  so  that 

m 


.+  t  .  + 

a  c,  —  0  ,  r,s —  i , . . •  ,m 

r  — i  rs 


we 


while  in  addition 
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{0} 


Cnti" 


This  guarantees  that 


A+  c 
r  — s 


0  for  all  r  and  all  s>i 


since,  for  s  >  i  ,  =  c  [i-1]  . 

— s  —  s 


Finally,  the  linear  functional 


i+m 

a. :  f  \ — ►  I  a . . f { j) 

1  -  j-i 

has  support  in  [i,i+m]  and  carries  _£j  to  zero  for  any  j  ^  i  (since  then 

* 

c . 1 . .  ,  ,  while  a.c.  *  1  .  It  follows  that  the  two  sequences 

— 3  j  [l ,i+m]  i-i 


-j  |  [ i,i+m] 


1 


c  ,  i  c,  ,  •  •  • ,  c.  and  A  ,  •  •  • ,  A  ,  u .  ,  A,  • 
—l—T.  — i  -  1  +  i  1 

J1  m 


-  •  t  A 


are  biorthonormal.  This  gives 


Corollary  4,  If  A  has 
B. 1  is  a  submatrix  of  A*”* 

l 


index ,  then  the  matrix 
f  specifically,  so  that 


in  (2.7)  can  be  chosen  so  that 


-1 

B. 

1 


^(-)r  i  ,  ...  ,  i+m  ^ 

m  m 


for  some  i-m  <  i^<  ...  <  i+<  i<  j 1  <  ...  <  j  _  <  i+m  * 

m  m 


Fxample  1  shows  that  we  cannot  count  on  choosing  F. 


from  consecutive  columns  of 


Corollary  4  shows  that,  if  A  is  boundedly  invertible  on  2  ,  i.e.,  if  A^~^  is  a 

P 

bounded  map  on  2  ,  then  B;  can  be  chosen  hounded  below  uniformly  in  i  .  This  will  be 

p  i  - 

important  when  it  comes  to  characterizing  bounded  invertibility  of  an  m-banded  matrix. 

As  a  further  illustration,  let  now  A  be  a  banded  Toeplitz  matrix.  Then  A  is 
strictly  m-banded  for  some  m  ,  and,  without  loss  of  generality, 

A(i,j)  =  ,  all  i,j 

for  some  seouence  (a  )  with  a  *  0  for  r  <  0  and  r  >  m  ,  and  a^a  ^  0  .  Let  z ,, 
r  r  o  m  i 

zm  be  the  m  zeros,  counting  multiplicity,  of  the  characteristic  polynomial  pft  = 
pa  for  ?  ,  given  by 
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m 


p  (  z)  =  E  a .  z3  . 
f  5=o  ^ 

If  these  zeros  are  all  simple,  then  is  spanned  by  the  m  sequences 

z,  :=  (  z  3  ) 

— 1  1  jss-co 

In  case  of  coincidences,  sequences  of  the  form 

(  jr  Z  -1)  ,  r=n, .. .  ,m.-1 

1  j  =  -°°  i 

appear,  with  the  multiplicity  of  z^  as  a  zero  of  •  consequently,  A  has  index 

iff  |z^{  ¥  1  ,  all  i  ,  i.e.,  iff  p^(z)  does  not  vanish  on  |z|  =  1  ,  and  in  that  case 

index(  A)  =  #{  z .  :  (z .  |  <  1  }  •  Itiis  shows  that  our  notion  of  index  is  an  extension  of 

l  l 

the  index  of  a  Ttoeplitz  matrix  as  used,  e.g.,  in  ftokhberg  and  Feldmann  f7J  .  Further,  if 

vi  * 

our  Toeplitz  matrix  A  has  index,  then  the  elements  of  K  are  not  only  bounded  at  *«>  , 

A 

but  they  actually  oo  to  zero  there  exponentially  fast.  Such  exponential  decay  also  occurs 

for  qeneral  m-banded  matrices,  but  only  if  the  assumption  that  A  have  index  can  be 

strengthened  to  A  havinq  a  bounded  inverse  (as  a  map  on  J l  ,  say). 

3.  Exponential  decay.  Exponential  decay  has  been  recognized  as  a  characteristic 
feature  of  the  bounded  inverse  of  a  linear  differential  operator  for  some  time.  Massera  and 
SchSffer  f P I  credit  Perron  (9]  with  having  first  observed  this  (for  nonautonomous  systems). 
Further,  they  have  introduced  the  term  "(exponential)  dichotomy"  to  describe  the 
concomitant  property  of  the  kernel,  i.e.,  of  the  linear  space  of  solutions  to  the 

homoqeneous  problem,  to  break  up  into  two  subspaces,  with  one  consistina  of  those  solutions 

which  are  bounded  (decay  exponentially)  at  -»  ,  and  the  other  of  those  solutions  which  are 
bounded  (decay  exponentially)  at  +«®  .  In  addition,  their  notion  of  " ( exponential ) 
dichotomy"  includes  a  certain  uniformity  with  respect  to  the  independent  variable  of  this 
direct  svjn  decomposition . 

For  the  case  of  band  matrices,  this  exponential  decay  is  of  course  well  recognized  in 
the  special  case  of  Toeplitz  matrices,  i.e.;of  constant  coefficient  difference  equations. 
Put  if  there  is  a  worked-out  theory  for  general  band  matrices  to  parallel  the  development 
in,  say,  Coppel  (4]  for  ordinary  linear  differential  operators,  I  have  not  been  able  to 
find  it.  I  have  only  seen  discussions  in  which  the  bands  are  assumed  to  become  constant 
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A 


asymptotically. 

All  results  concerning  the  exponential  decay  of  inverses  of  hand  "atrii-p?  cat  W.  ra'-v. 
on  the  following  theorem  due  to  Demko  [5! ,  or  its  obvious  general izations . 

Theorem  1 .  [Demko]  If  A  is  a  finite  invertible  band  matrix,  then  there 
const  and  A  e  ]0,1[  which  may  depend  on  II  All  ,  II A  ^  II  and  the  band  width  of 
on  the  order  of  A  so  that 

(3.1)  |A-1(i,j)|  <  const  A^  ^  ,  all  i,j  . 

A  simple  proof  which  makes  the  constants  const  and  A  explicit  and  makes  obvious 
how  this  result  would  apply  in  a  multivariate  situation  (i.e.,  when  i,  j  ra.noe  over  a 
multidimensional  grid)  can  be  found  in  [2]  (see  the  proof  for  Lemma  2  below).  The  essentia 
feature  of  the  argument  (and  the  wherefore  of  the  exponential  decay)  is  already  evident 
from  the  argument  for  the  following  lemma  and  its  corollary  (also  from  [2]). 


ex  i  st 

P  hilt  r.o*- 


Lemma  1.  If  A 

map  on  l  for  some 
P 


is  m-banded  (with  1=0),  and  bounded  and  boundedlv  invertible  as  a 
p  <  ”  ,  then,  for  any  ^  and  any  i  <  j  , 


(3.2) 


llfl..  . 

-I ti,j 


—  I  [  i-m ,  j+m]  p 


with 


:=  II  All  II  A  It 


Proof,  Let  f'  :=  fl,.  ,  f"  :  =  fl,.  ,  .  Then  snpn  Af '  C.  fi-n,i'  and 

-  -  -Hi, 3]  -  — |  [  i-m,  j+m]  J 

supp  Af"  =  supp  A(_f-_f")  C  ZN(i-m,j]  ,  hence 

supp  A_f '  A  supp  A_f  "  =  «<  . 


Therefore 


IAIP(«f"«P  -  If I !P)  =  It  AH  Pl(  f "  -  f*llP 


>  IIAf“  -  Af 


•  »P  - 


I  Af 


M.P 


I  Af 


•  ll  P 


>  II  A 


’ 1  II  _P  (  II  "  I!  P  +  Ilf1  II  P) 


which  proves  (3.2).  Ill 


Oorollary  1.  If  A  is  m-banded,  and  bounded  and  houndedly  invertible  as  a  linear  -ar 


on  1  for  some  p  <  ”  ,  then,  for  any  f  £  K  and  anv  i  , 
P  * 

llf[i+jm]llp  >  const  A^  llf[i]llP 
-  p  -  P 


(3.3) 

either  for  j  =  1,2,3,...  or  else  for  j  =  -1 ,-2,-3, . . .  ,  with 

(3.4) 


A  :=  (<P  +  1)/(kP  -  1)  ,  const  :=  -j  (A-1)/A 


Proof.  Let  a  :=  llf[i+vm]ll  .  Then,  from  (3.2), 

-  u  —  p 

A  £  a  <  £  a 

v  v 

-j<v<j  -j<v<j 

hence 
(3.5) 

Suppose  now  that  (3.3)  is  violated  for  some  j  =  r  and  j  =  s  with  r  <  0  <  s  ,  and 
assume  without  loss  that  r  <  -s  and  that  j  =  r  is  the  laroest  inteaer  <  -s  for 
(3.3)  is  violated.  Then,  from  (3.2)  and  the  choice  of  r  and  s  , 


A.  a  <  £  a 

0  .  .  v 


(3.6) 


£  a  <  (A-1)  '(a  +  a  )  <  (A-1)  'const  (A  r  +  As)  a 

v  r  s  n 

r<V<S  1  .-r-1  ,.-i, 

=  2  (A  +  A  ’  *0  • 


On  the  other  hand,  by  the  choice  of  r  and  (3.5), 


£  a 

v 

r<v<s 


£  a  +  £  a  >  const  - - - - -  a  +  A  a 

y  v  A  -  1  0  i1 

r<v<-s  -s<v<s 

=  1  -  AS_1)  a„  *  AS-'an 

-  ^A-17-1  +  AS_1)  an 


which  contradicts  (3.6).  Ill 
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Corollary  2.  If  A  is  m-banded,  and  bounded  and  boundedly  invertible  on  some  i 
with  p  <  “  ,  then 


(3.7) 


* 

there  exist  const  >  0,  A  >  1  so  that,  for  all  i  ,  all  Jf  e  jL 
lf[i-(*j)m]  II  >  const  A3  «f[i]!l  , 


The  proof  of  Lemma  1  is  based  on  the  following  observations:  (i)  the  support  of  Aj 
is  only  slightly  larger  than  that  of  '  i.e., 

supp{A_j)  C  supp  £  +  [-m,0]  j 

and  (ii)  if  £  e  ,  then  supp(Ac^)  =  supp  A{  f_-c^)  .  The  second  step  cannot  be  used  any 

more  when  J?  $  ,  but  the  same  idea  still  works  when  has  3mall  support,  e.g.,  when 

Af  -  6. 

—  — k 

In  this  case,  setting  f'  :=  f|  ,,  , ,  f"  fl  .  ..  ,  we  find 

-  -|Z\[i-m,3+m]  -  -|z\[i,g] 

supp  Af'  C  Z\[i-m,j) 

supp  Af"  ^  supp  A(f-f“ )  U  supp  Af  C  [i-m,j]  VJ  {k} 

so  that,  for  k  e  [i-m,j]  ,  supp  Af/  A  supp  Af "  =  ^  ,  and  therefore,  concluding  as  in 
the  proof  of  Lemma  1,  we  obtain 


Lemma  2, 

I  for  some 
P 

implies 

(3.8) 


If  A  is  m-banded,  and  bounded  and  boundedly  invertible  as  a  linear  map  on 

p  <  “  ,  then,  for  all  i  <  j  and  all  k  e  [i-m,j],  Af  =  6,  and  f  e  A 

—  -k  p 


!-|zS[i-m,j+m] 


»p  <  «f 


kP+1  -|zMi,j) 


lP  ,  with  k  :=  1  All A_1 1  . 


Corollary.  If  A  is  m-banded,  bounded  and  boundedly  invertible  as  a  linear  map  on 

ip  for  some  1  <  p  <  •>  ,  then  ( A  J  ^  )  1  =  bL  with 

P  P 

(3.9)  |B(i,j)|  <  const  ^ 


for  some  const  and  some  \  e  ]0,1[  which  depend  only  on 


IAI,  I  A_1 1 


and  m  . 
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Proof.  Since  UB(*,k)l  <  II A  1 1I  ,  the  conclusion  is  immediate  in  case  p  <  «  .  If 

-  »  p 

p  »  “  ,  then  the  lemma,  applied  to  AT  ,  gives  the  conclusion  for  BT  rather  than  B  . 
But  that  is  clearly  enough.  Ill 


As  Demko  has  already  stressed,  such  a  corollary  shows  that  A  is  boundedly  invertible 

on  every  t  if  it  is  boundedly  invertible  on  some  l  .  This  raises  the  question  of  the 
P  P 

best  choice  of  X  in  (3.9),  which,  from  the  argument,  could  be  chosen  as 


(3.10) 


,  m 


u  aii  p  -  ii  a~  1  a -p 


_E  = 


II  All  p  +  a  A- 1  u -p 


1  -  2/fllAl  1A-1|  )P 

P  P 


P  P 

cT 

T 

equivalent  to  the  same  statement  for  B  ,  we  can  always  choose  A  as 


for  any  particular  p  •  Since  Ucil^  =  1/p  +  1/p'  -  1  /  while  (3*9)  is 


(3.11)  Xm  =  1  -  2/  min  («A«  .A"1.  )min{p'P/(p-1)J  , 

Kp<»  P  P 

but  it  is  not  clear  to  me  for  what  p  this  minimum  might  be  taken  on. 


We  are  now  ready  to  prove  the  main  result  of  this  section. 


Proposition  3.  Let  A  be  a  bounded  strictly  m-banded  matrix.  Then  A  is  boundedly 

invertible  on  l  iff  (i)  A  has  index;  (ii)  for  each  i  ,  the  matrix  B,  in  (2.7)  can 
P  1 

be  so  chosen  that  sup  IB  B  <  «  ;  and  (iii)  the  elements  of  0l  decay  exponentially 
i  i  « 

uniformly,  i.e.,  (3.7)  holds. 

Proof.  The  sufficiency  of  these  conditions  is  immediate:  (i)  allows  the  construction 
of  A(“’  ,  (ii)  implies  that,  for  each  i  , 

I A^“* ( i+j ,i) I  <  const  ,  j«0,...,m, 

with  const  independent  of  i  ,  and  (iii)  then  implies  that 
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1 


IA^  * (• ,i) [i+mj] I  <  const  X  ^  ,  all  j 
for  some  const  and  some  X  e  (0,1(  independent  of  i  or  j  .  This  shows 
uniform  exponential  decay  away  from  the  "main"  diagonal,  hence  A^-*  maps 
for  any  particular  p  e  [1,*»J  .  Since  we  already  know  that  AA*-*  =  1 

shows  that 


A^-^  to  have 

l  into  itself 
P 

A(-)A  ,  this 


=  (ftU  r’  '  K 


p<« 


p  p 

The  necessity  is  a  bit  harder  to  prove,  but  earlier  results  contain  all  of  the  work. 

If  (a|^  )  ^  exists,  then,  from  the  corollary  to  Lemma  2,  A  is  boundedly  invertible  on 

,  hence  A  has  index,  and,  since  then  (aL  )  1  =  A*  *  I  ,  condition  (ii)  follows 

00  00 

from  Corollary  4  ho  Proposition  2,  while  (iii)  follows  directly  from  Corollary  2  to 
Lemma  1  .  | | | 


Remark .  This  necessary  and  sufficient  condition  for  the  bounded  invertibility  of  a 
strictly  m-banded  matrix  is  not  quite  the  "exponential  dichotomy"  introduced  by  Massera  an! 
Schaffer  to  characterize  the  bounded  invertibility  of  an  ordinary  linear  differential 
operator.  As  Coppel  [4jChap.2]  describes  it,  such  "exponential  dichotomy"  requires,  in 
addition  to  (3.7),  that 

(3.12)  for  some  const  and  all  i  ,  all  f  e  MQ£)  [i]  1  <  const  ll^ftijl  , 

with  Q  the  linear  projector  on  associated  with  the  decomposition  \  \  •  k ' 

i  •  e  •  # 

ran  Q  *  U*  ,  ker  Q  *  ljl_ 

A  A 

In  Proposition  3,  this  condition  is  replaced  by  condition  (ii)  which  also  prevents  the 
angle  between  tl+(i]  and  Kl-[i]  from  going  to  zero,  but  in  a  different  way.  I  do  not  know 
whether  (3.12)  is  necessary  for  the  bounded  invertibility  of  A  ,  but  I  doubt  it. 

The  argument  does  show  that  (i)  and  (iii)  alone  imply  already  the  bounded 
invertibility  of  DA  for  some  suitably  chosen  invertible  diagonal  matrix  P  . 


4.  The  main  diagonal.  In  an  attempt  to  understand  how  the  inverse  of  a  biinfinite 
band  matrix  might  be  approximated  by  inverses  of  finite  sections  of  A  ,  one  is  naturally 


led  to  the  question  of  what  might  be  the  main  diaqonal  of  A  .  For  a  precise  definition,  we 
need  some  notation. 

Let  I,  J  be  integer  intervals.  Then 

flI,J  !=  *|ixj  = 

denotes  the  corresponding  section  of  the  biinfinite  matrix  A  .  We  can  think  of  A ^  j 
simply  as  a  1 1 1 x | j| -matrix.  But,  A^  j  also  describes  the  nontrivial  part  of  the  linear 
map  PjAPj  with 


^(  i)  ,  i  E  r 
0  ,  i  i  I 


More  precisely,  Aj  j  is  the  matrix  representation  (with  respect  to  the  canonical  basis) 
of  the  linear  map 

PI^|ran  P.) 

and  we  will  not  distinguish  between  these  two. 

Suppose  that  A  is  m-banded ,  bounded  and  boundedly  invertible,  hben  we  know  that  the 
linear  system 

(4.1)  Ax_  = 

has  exactly  one  solution  in  i  in  case  b  e  i  .  We  may  then  try  to  apDroximate  the 

P  -  P 

solution  x  by  truncation,  i.e.,  by  the  solution  jCj  ,  if  any,  of  the  finite  (sauare) 
linear  system 


(4.1)' 

with 


-lx 


AI  AI,J  '  J  s*  I  +  Tj  :=  {i+Tj  :  i  e  1} 

and  r^  some  integer. 

Call  this  projection  scheme  suitable  if  (4.1)'  has  exactly  one  solution  for  all 

larqe  I  and  II  x  -  x_  n  —+  0  . 

1  p  I+Z 

Take  specifically  p  <  00  ,  so  that  p  converoes  pointwise  to  the  identitv  on  1 

as  I  - ►  Z  •  Then  (see,  e.q.,  Gokhberg  and  Feldmann  [7;  Theorem  II. 2.1])  the  projection 

scheme  is  suitable  iff 
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(4.2)  lim  1A*1#  <  » 

I+Z 

i.e.,  Ai_1  exists  for  all  sufficiently  large  1  and  can  be  bounded  independently  of  I  . 
Note  that  Demko's  result  makes  it  unnecessary  here  to  specify  in  which  p-norm  we  measure 
I A  1 1I  ,  since  A  is  m-banded.  The  m-bandedness  of  A  also  restricts  the  possible 
choices  for  rj  ,  since  Aj  is  trivially  noninvertible  unless  0  <  r  <  m  .  Actually,  as 
we  now  show,  for  our  projection  scheme  to  be  suitable  we  usually  must  have 

rj  =  m+  for  all  large  I  . 


Lemma  3. 


(4.3) 


Let  A  be  m-banded,  bounded  and  boundedly  invertible.  If  (4.2)  holds,  then 
there  exists  const  >0  so  that,  for  all  large  I  “s  tttt  ]  , 
for  all  e  Df.j.j.**  >  const  l£[t  ]• 

with  I+  I\J  and  i”  (I+m)\J  . 


Proof .  Let  e  .  Then,  for  i  e  I  , 

(AP  f](i)  =  ( A  f) ( i )  =  Z  A(i,j)f(j)  =  -Z  A(i,j)f(j)  -  -  Z  A(i,j)f(j> 

„  ,  *J  '  jeV'J  "  jeI+UI~ 

Consequently 

II  A  P  f  II  <  BAH  Ifj  a  I 
T  ■*  —  00  —  [  +  —  00 
‘i  l/I 


in  case  Aj  is  invertible. 

If  now,  in  addition,  e  ,  then  Corollary  2  to  Lemma  1  supplies  const  >  0  and 

A  >  1  independent  of  f_  so  that 

ljf[t+]  >  const  B£[t++ j]  ,  j=1,2,3,... 

and  therefore 


II.  <  111  +I.  +  'IIjI. 


<  (l  +  ilA_  'll  I  All  )  max{  If  I  I  ,  const  A  ^ 1  ^ f  (t+l  I  }  . 

V  T  00  00  ‘  —  I  +00  —  00 

ll 

<  »  ,  then,  for  all  sufficiently  large  |l|  , 

(l  +  »AI'1IIAl)  const  A  1 1 1  <  1  and  1  +  II  A^  '  1 1  Al  <  const* 


If  now  | I  At  1 1  <  °°  ,  then,  for  all  sufficiently  large  |l|  , 


i 

1 
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and  then  (4.3)  follows  for  *  =  +  with  const  =  const 


The  proof  for  *  =  -  is  analoqous.  |  I  I 

If  A  is  strictly  m- banded  (hence  Jf  e  and  £[  i]  =  0_  implies  f  *  £  )  ,  then  a 

particular  conseauence  of  (4.3)  is  that 

*  * 

(4.4)  XL  is  lin .independent  over  I 

A 

This  implies  that 


*  *  *  I  ' 

m  -  dim  XI  <  III  = 

J'  m-r^  ,  if  *  =  - 

and  n+  =  then  follows. 

These  considerations  motivate  the  following  definition  (see  [3]). 

Definition.  The  hounded  and  boundedly  invertible  biinfinite  matrix  A  (as  a  map  on 

i  t  sav)  has  its  r-th  band  as  main  diaqonal  provided  lin  II  ( A.  )  1 1I  <  . 

oo  -  T+Z  I,I+r 

As  noted  already,  in  that  case  A-1  is  the  stronor  limit  (in  any  S,  with  p  <  00  ) 

P 

of  (  Aj  i+r)~1p!  •  r  =  m+  (at  least  in  case  A  is  strictly  m-banded) . 

Proposition  4.  Let  A  be  a  strictly  m-banded,  bounded  and  boundedly  invertible 
matrix.  Then  A  has  its  r-th  band  as  main  diagonal  iff  (4.3)  holds. 


Proof .  Lemma  3  establishes  the  necessity  of  this  condition.  As  to  the  sufficiency, 
let  P  be  a  matrix  with  support  in  (I+r)xi  .  Then  Pj+r  j  "  if  an<1  on^y  if 

P  =  A-1  -  N  on  (lU(I+m)Jxi 

with  V( -,k)  e  ,  all  It  e  I  .  In  other  words,  Aj.  I+r  is  invertible  iff  we  can  find, 

for  each  k  in  I  ,  an  in  HA  which  agrees  with  _c^  ,  the  k-th  column  of 

A-1  ,  on  I+  :=  I\(I+r)  and  on  i”  :=  (l+m)S(I+r)  ,  and,  in  that  case,  (c^  -  )  j  ^ 

provides  the  k-th  column  of  the  inverse. 

we  already  noted  that  (4.3)  implies  (4.4)  and,  in  particular,  that  r  =  m+  . 


f  "I  m  •* 

Consequently,  we  can  find  vf?jJjEj+  in  so  that  .Qj(i)  ~  6  ^  $  all  i,i  l  • 

then  implies  that 


II  g  .  [t  ]  II  <  const 


and  therefore,  by  Corollary  2  to  Lemma  1, 


iii 


llcj.tt  ]  II  <  const  X  ,  all  j  c  I 

for  some  fixed  X  e  [0,1[  .  Analogously,  there  are  _g^  c  Ji  so  that  ^(i)  =  x r'  - 

i,j  e  I  and  these  satisfy 

II q^  [t+]  II  <  const  X^  ,  all  j  z  I 

This  reduces  the  task  of  determining  =  p(«,k)  to  solvina  the  linear  svste^ 

£k<^  =  +r  .  nki  £.j(i>  -  1  £  I+WI~ 

jel  UI  3  3 

and  this  system  has  a  coefficient  matrix  which  differs  from  the  identity  matrix  bv  no  more 

than  const  X^  ,  hence  is  invertible  for  all  sufficiently  laroe  III  .  Trite 

* 

n,  s=  Z  .  n,  .  q.  .  Then  we  have  further  by  Cbrollary  2  to  lemma  1  that 
-k  jeJ*  kj-j 

I)  <  const  X3f1  +  X|j|)  llc^*!!  ,  .1  =  1,2,... 


It  follows  that 


.-I,.  ,,  -1,,  _  _  „  -1,  ,dist(  i  ,Z  SI)  'm 

I  A  (i,k)  -  A  (i,k)  4  const  II A  II  X 

I  «> 


i.e.,  converges  exponentially  fast  to  A-1  in  its  interior.  In  any  event, 

lim  II  A_  _  1 1I  4  const  II  A  ^  II  .  I  I  I 

.  „  I, I+r  « 

I+Z 


Remark .  I  now  question  whether  the  seeminalv  weaker  condition  used  in  '.V  to  define 
main  diagonal,  viz.  that  (  Aj  I+r)_1  exist  for  all  laroe  I  and  that 

A  hi.j)  =  lim  ( A  )  hi.i),  all  i,i 
I-Z  1,1  r 

is,  in  fact,  eouivalent  to  (4.3).  Further,  the  linear  independence  of  UA  over  I+ U 1 
implies  the  existence  of  ( Aj  »  hut  1  110  not  know  whether  the  converse  v>.->l.ds. 
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Remark .  The  matrix  of  Example  1,  though  bounded  and  boundedly  invertible,  does  not 


have  a  main  diagonal  since  the  element! s)  of  vanish  at  every  other  point,  so  (4.3) 

cannot  hold  for  all  large  I  .  But  (4.3)  does  hold  for  a  subsequence,  hence  its  center  ban 
is  main  in  this  weaker  sense.  By  contrast,  any  bounded  and  boundedly  invertible  Tienlitz 
matrix  does  have  a  main  diagonal  (as  is  well  known,  see,  e.g.,  Cokhberg  and  Feldman  '7’) 
since  the  elements  of  are  (possibly  extended)  exponential  sums  ^nvolvino  m* 

" freauencies”  ,  hence  Vl\  is  linearly  independent  over  any  m*  consecutive  points,  and 
uniformly  so  . 
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